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SYSTEMS AND METHODS FOR REAL-TIME NETWORK-BASED 
VULNERABILITY ASSESSMENT 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This Application claims priority from co-pending provisional application 
serial no: 60/461818 filed on April 11, 2003, the contents of which are 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
Technical Field 

[0002] The present invention relates to a system that ensures real-time network- 
based vulnerability assessment of an enterprise/consumer host/device. The 
present invention also provides a method of implementing the system to ensure 
real-time network-based vulnerability assessment of the host/device. 

Description of the Related Art 
[0003] Vulnerability assessment (VA) 

[0004] A host (or a device) connects to a network by running one or more 
network accessing processes, typically called network services. A network 
service is so called because the service provides some service to the user of 
the host (or the device) that entails communication to and from the some other 
host/device on the network; for instance, a service could be a mail service 
provided by a mail server, or a chat service provided by a chat client/server. 
These service processes access the underlying network interface software to 
provide the required service(s) to the users. For instance in the TCP/IP 
protocol, a popular networking protocol, if the use of the Sockets utility is 
considered, a utility that is usually used to access the network, these services 
either access a network port actively by making a connect call to access 
another service on another machine across the network — one having a 
different IP address — or wait passively by making listen and accept calls for 
another process on the network running on a different host or a device to 
connect to this service. A port is a logical abstraction that denotes an endpoint 
on each of the two machines which have a logical connection between them. 
Different TCP and UDP services run on different ports. Protocols other than 
TCP and UDP have other paradigms to access the network. 
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[0005] For instance, a network service such as ping that uses the ICMP protocol 
does not entail the use of ports. 

[00061 There could be a security breach in a service made from across the 
network if there is security vulnerability in the service. Security vulnerabilities 
could be of different kinds: for instance there could be a vulnerability in the 
software of the executable that comprises of the service itself; several kinds of 
vulnerabilities are known; for instance a service could have a buffer overflow 
vulnerability [2] [Counter Hack, A step-by-step Guide to Computer Attacks and 
Effective Defenses, Ed Skoudis, Prentice Hall (2002)] in it, or it could have a 
hidden backdoor [2] [Counter Hack, A step-by-step Guide to Computer' Attacks 
and Effective Defenses, Ed Skoudis, Prentice Hall (2002)]. The Common 
Vulnerabilities and Exposures (CVE) [3] [http://cve.mitre.org] list keeps track of 
known vulnerabilities in standard network service programs offered by well- 
known vendors. It is also possible that the software itself might not have any 
vulnerability but the service is configured in such a way to lend itself to security 
vulnerability. For instance, the popular UNIX based sendmail service could be 
configured to enable relaying, whereby users can use the particular sendmail 
server to send spam to other users. It is also possible that a hacker has planted 
a listening backdoor to which he/she can connect from outside. Other security 
breaches in a service could be made via a denial-of-service attack conducted 
on the service. In a denial-of-service attack, the port on which the service is 
running or the host itself — or the host itself in case of services not running on 
any ports — is flooded with packets so as to exhaust the resources {bandwidth 
and/or memory) available for a genuine party across the network to access the 
service or for the service to have access to a genuine party across the network. 
Genuine here refers to the users who are not flooding the service with a denial- 
of-service attack, and want to connect to the host to avail of the particular 
offered service. 

[0007] Vulnerability assessment (VA) is the process of finding out if the network 
services that run on a host have vulnerabilities that are prone to security 
violations of the above kind. . 
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[0008] Vulnerability assessment tools are of two kinds: host-based and network- 
based. 

[0009] Host-based vulnerability assessment is done by running a VA tool on the 
host itself and it can find vulnerabilities in all the services that the host runs, not 
necessarily just services accessible remotely. Network-based vulnerability 
assessment is done by running a vulnerability assessment tool to access the 
target host from across the network and it can thus find vulnerabilities in the 
network services remotely. In this invention, network-based vulnerability 
assessment is only considered. {Target here refers to the host or device the 
vulnerability of which is to be assessed.) Future references to vulnerability 
assessment in this description or in the claims, would imply network-based 
vulnerability assessment unless specified otherwise. The (network-based) 
vulnerability assessment itself is usually carried in two stages: the first stage 
comprises of finding out which services are running and the second stage 
comprises running scripts to do vulnerability assessment on these services. 
Part of the first stage consists of port scanning. Port scanning is the process of 
figuring out if a particular port on the target host is open, and this is done by 
sending various kinds of packets to the port. These packets could include 
among others TCP SYN, and ACK packets, UDP packets etc. Depending on 
the response received, the port scanner concludes if the particular port is open 
or not; in other words, if there is a service listening on the particular port. The 
other part of the first stage involves finding out whether other services — ones 
not associated with any port — such as ICMP services are running on the host 
machine. The second part of the first stage involves running scripts to identify 
the services that are listening on the various open ports found. This is done by 
giving commands to read the banners of these services remotely. 

[0010] The second stage in Vulnerability assessment involves running the 
scripts to figure out vulnerabilities in the services found in the first stage. 

[0011] A VA tool generally has a list of scripts, one each to test for each 
vulnerability. -For each of those ports which are open as found in the port 
scanning stage, the VA tool runs scripts to figure out which service may be 
running on the port, and then runs the scripts to test for the presence of those 
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vulnerabilities pertaining to the particular service(s). In this way, the VA tool 
finds out if a particular vulnerability among the list of vulnerabilities for which it 
has scripts exists in the service. 

[0012] VA tools also find vulnerabilities in network services that are not bound to 
any port. As mentioned before, this involves sending packets such as ICMP 
packets to figure out if there are network services that are not bound to any port 
running on the host in the first stage. The second part would again entail 
running a script to send various specially carved packets to test for 
vulnerabilities in these services. 

[0013] The pertinent point about VA topis is that they do not discover new 
vulnerabilities in a service on the fly. They only check for and detect previously 
known vulnerabilities (those whose signatures they know of) in services running 
on the target host. Most VA tools have a provision for updating and augmenting 
their vulnerability scripts so as to include testing for latest and newly discovered 
vulnerabilities in services. 

[0014] SATAN [4] [Practical Unix and Internet Security, Simson Garfinkel and 
Gene Spafford, 2 nd Edition, 1996, Oreilly] was one of the first VA tools 
developed. Now, there are many open-source as well as proprietary VA tools 
available. Prominent among them are products from eEye Digital security, 
Nessus, NetlQ, Network Associates, Patchlink, Harris, Cisco, Bindview and 
Internet Security Systems. 

[0015] VA tools are generally run once in a while; typically security managers 
run these tools once a month or once in a few weeks or once a day depending 
on the security policy of the enterprise. 

[0016] The following are the factors concerning VA tools and the target host 
relevant to this invention. 

[0017] On any host/device in an enterprise network, as users use the host, they 
start and stop various network services (in the case of TCP and UDP services, 
a port is associated with these services) in the course of their work. For 
instance, a user might start a chat software such as Yahoo messenger; another 
user may share his/her files through an SMB share, or another user might start 
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an ftp server to share files. As users start new services or reconfigure existing 
services, they can make these services vulnerable provided these services 
have in them the kind of vulnerabilities described in the above section. Thus, 
the vulnerability status of a host changes dynamically as a function of time. 

[0018] Given that a security policy of an enterprise dictates that VA tools be run 
once in a few days/weeks or months, and VA tools are run as per above, the 
vulnerability status of the host is not checked in the intermediate time period, 
that is between two runs of a VA tool. (To be precise, it is possible for an 
enterprise to have a security policy that mandates running vulnerability 
assessment tools all the time except that this would take a whole lot of 
bandwidth and could make normal working of the system difficult.) As new 
services get started and stopped and reconfigured all the time, vulnerabilities go 
undetected in the host and the host is prone to attacks. 

[0019] Thus, it becomes important to make sure that not just vulnerabilities in 
services are detected once in a while (as and when VA tools are run as per 
current security policies), but that vulnerabilities should be detected the moment 
they occur or are manifested- This then is the one of the themes of the 
invention described here. (The invention is described in detail in the subsequent 
sections.) The invention tracks — via deploying of an agent — the start of 
services in real-time, and detects the vulnerabilities found in the services in real- 
time. The above is carried out by monitoring the status of ports — whether open 
or not — on the various active interfaces of the host/device. Vulnerabilities 
produced due to reconfiguration of services are also detected in real-time. (Here 
the assumption is that to reconfigure a service, one must stop it and then start it 
again.) Even backdoors are detected in real-time. A backdoor is a listening 
service that a hacker might plant on a machine, through which he/she would 
want to connect to the machine. 

[0020] The other important theme of the invention is one which results in a 
"deploy and forget" model for this invention and is a major source of 
convenience and saving of resources for enterprises/consumers. Currently VA 
tools are run on specific times and as per specific schedules. Apart from 
missing the vulnerabilities that are manifested between two runs of the VA tool, 
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the other problem that comes up because of the above is that a run of the VA 
tool may be redundant if there is no change in the vulnerability status of the 
network since the earlier run of the VA tool. This invention makes it possible to 
run a VA tool and further only those vulnerability tests from the VA tool only 
when they are required to be run, and this run is triggered automatically by the 
system. Thus, deploying a product based on this invention results in a "deploy 
and forget" model of invention, where the security administrator need to only 
deploy the tool once and then wait for alerts on new vulnerabilities. Issues such 
as when to run the vulnerability tests and to what extent is taken care of by the 
tool by itself. This then is the other theme of this invention. 

[0021] Related Work: 

[0022] As regards the first theme of the invention, there has been related work 
in areas such as vulnerability assessment [5,9,1 0,1 1]{["System and method for 
rules-driven multi-phase network vulnerability assessment" United States 
Patent, 6,324,656, November 27, 2001 , Gleichauf , et al., Cisco Technologies 
Inc.], ["Method and system for adaptive network security using intelligent packet 
analysis" United States Patent, 6,499,107, December 24, 2002, Gleichauf , et 
al., Cisco Technologies, Inc.], ["Method and system for adaptive network 
security using network vulnerability assessment" United States Patent, 
6,301,668, October 9, 2001, Gleichauf, et al, Cisco Technologies, Inc.], 
["System and method for real-time insertion of data into a multi-dimensional 
database for network intrusion detection and vulnerability assessment", United 
States Patent, 6282546, August 28, 2001, Gleichauf, et al, Cisco Technologies, 
lnc.]}[5] ["System and method for rules-driven multi-phase network vulnerability 
assessment" United States Patent, 6,324,656, November 27, 2001 , Gleichauf , 
et al., Cisco Technologies Inc.] relates to doing vulnerability assessment using a 
multi-dimensional database. It does not track the changes in the vulnerability 
status of the host/device due to start and stop of services in real-time, and 
incorporate it into its multi-dimensional database. [11] ["System and method for 
real-time insertion of data into a multi-dimensional database for network 
intrusion detection and vulnerability assessment", United States Patent, 
6282546, August 28, 2001, Gleichauf, et al, Cisco Technologies, Inc.] has a 
facility for real-time insertion of data feed into the database, but it is picked up 
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from data processed by an intrusion detection system. Real-time tracking of 
start and stop of services for purposes of real-time vulnerability assessment is 
not part of the above. 

[0023] Qualys [6] ["Qualys First to Provide Real-Time Vulnerability Assessment 
for Check Point Firewalls" 

http://www.checkpoint.com/press/partners/2002/qualys032502.html] claims to 
do a vulnerability scan of a network when a configuration of a firewall 
(specifically Checkpoint firewall) deployed in the network is changed. A firewall 
is not a network service; (a network service is a service that involves to and 
from communication with another entity across the network.) A firewall is 
basically a filter meant to secure the network. Also, since a firewall is a security 
service, it is obvious that a change in firewall configuration will change the 
vulnerability status of the network. What is subtle and non-obvious however is 
that vulnerability status of the network can change anytime a new network 
service is started on a host or the configuration of any network service running 
on the host is changed. 

[0024] There is also work done in the area of execution monitoring of 
applications [7] [Automated Detection of Vulnerabilities in Privileged Programs 
by Execution Monitoring", Ko et al.,.Proc. of the 10th Annual Computer Security 
Applications Conference, Orlando, FL (found at 
http://seclab.cs.ucdavis.edu/papers.html), 1994] but this work relates to finding 
out whether these services whose execution is being monitored are 
compromised due to vulnerabilities present in them, by checking their execution 
traces. This invention is different in the sense that the present invention does 
not monitor the execution trace of the application. The present invention signals 
the beginning or the reconfiguration of the application and then trigger a 
vulnerability assessment tool which will check for potential vulnerabilities in the 
service, and not for actual compromises. The former work comes under the 
area of intrusion detection while the present invention comes under the area of 
near real-time vulnerability assessment. 

[0025] Other work peripherally related is in the area of patch management [8,12] 
{[ http-y/www.patchlink.com], ["Non-invasive off-site patch fingerprinting and 
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updating system and method", United States Patent Application, 20020100036, 
July 25, 2002, Moshir Sean et al, Patchlink.com Corporation]}. Patchlink is a 
company which has a patch management product The product does a 
Vulnerability assessment on the enterprise host, and updates various software 
installed on the host with patches. The closest Patchlink's product comes to a 
feature of the present invention is their patch-compliance feature wherein if the 
feature is invoked, the patchlink product tracks if any of the patches deployed 
have been rolled back. Thus, there seems to be a real-time tracking of rollback 
of patches which is a small part of tracking whether a service is reconfigured. 

[0026] There is also work done in the area of real-time vulnerability assessment 
[13] ["Network vulnerability assessment system and method", United States 
Patent application, 20030028803, February 6, 2003, Bunker Nelson Waldo V. et 
al]. However, the real-time here does not refer to real time tracking of the 
beginning of services. 

[0027] As regards the second theme of the invention, Qualys has a web 
services model for its vulnerability assessment offering where they do an 'on 
demand' vulnerability assessment. Here, the security administrator can give 
inputs to Qualys on when he/she wants their vulnerability assessment tool — 
which is launched from a web-server on the network — to run. However, this is 
different from the 'deploy and forget' model of the present invention which is a 
'run when the system requires it' model which runs only those vulnerability 
assessment tests which are needed, and when they are needed. This need is 
determined not arbitrarily or wishfully by the security administrator but is 
determined by which services are started at what time, and thus by change in 
the vulnerability status of the system. Thus, the present invention does a more 
optimal job, not to mention that an 'on demand* model can miss vulnerabilities 
which the present invention cannot. 

[0028] [17] ["System and method for network vulnerability detection and 
reporting", United State patent application, 20040015728, Cole David M, 
Hanzlik Dennis J., Filed March 10, 2003] is an invention that is about an 
improved way of doing vulnerability assessment. [16] ["Tightly integrated 
cooperative telecommunications firewall and scanner with distributed 
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capabilities", United States Patent, 6226372, Beebe, et al, May 1, 2001] 
combines firewall and scanner technology. 
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[0040] 11) "System and method for real-time insertion of data into a multi- 
dimensional database for network intrusion detection and vulnerability 
assessment', United States Patent, 6282546, August 28, 2001, Gleichauf, et al, 
Cisco Technologies, Inc. 

[0041] 12) "Non-invasive off-site patch fingerprinting and updating system 
and method", United States Patent Application, 20020100036, July 25, 2002, 
Moshir Sean et al, Patchlink.com Corporation. 

[0042] 13) "Network vulnerability assessment system and method", United 
States Patent application, 20030028803, February 6, 2003, Bunker Nelson 
Waldo V. et al. 

[0043] 14) www.nessus.org, Nessus, the open-source VA tool. 

[0044] 15) Visual Modeling with Rational Rose and UML, Terry Quatrani, 
Addison Wesley, 1998. 

[0045] 16) "Tightly integrated cooperative telecommunications firewall and 
scanner with distributed capabilities", United States Patent, 6226372, Beebe, et 
al, May 1,2001. 

[0046] 17) "System and method for network vulnerability detection and 
reporting", United State patent application, 20040015728, Cole David M, 
Hanzlik Dennis J., Filed March 10, 2003. 

[0047] 18) "Method and system for configuring and scheduling security audits 
of a computer network", United States patent application, 20020104014, Al 
Zobel, Robert David et. al, August 1, 2002. 

SUMMARY 

[0048] According to one embodiment, the invention provides for a system of 
real-time network-based vulnerability assessment of a host/device by tracking 
the status of ports — whether open or not — and the status of various interfaces 
— whether active or not — of the host/device and then assessing the 
vulnerabilities in the network services running on the ports remotely. 
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[0049] According to another embodiment, the invention accomplishes the goal 
of real-time vulnerability assessment by consuming as little communication 
bandwidth as possible by doing incremental vulnerability assessment as far as 
possible. 

[0050] As per yet another embodiment, the invention accomplishes the goal of 
real-time vulnerability assessment by running only those vulnerability tests 
which are required and not run more tests. 

[0051] As per yet another embodiment, the invention describes a system that 
does not miss any vulnerability while at the same time conceives of a tool that 
enables a 'deploy and forget' model; that is, the tool has to be deployed only 
once, and the security administrator does not have to schedule vulnerability 
assessment tests but the scheduling of the tests and runs of the tests take 
place according to the needs of the system while at the same time not 
consuming high bandwidth and other resources. 

[0052] As per yet another embodiment, a method of .implementing said system 
to assess vulnerabilities in real-time is provided. 

BRIEF DESCRIPTION OF THE ACCOMPANIED DIAGRAMS 

[0053] A brief description of the diagrams along with their legend is given below. 

[0054] Fig 1 depicts a system for real-time vulnerability assessment of a 
host/device as per one embodiment of the invention, the system diagram of the 
invention. 

[0055] Legend: 

[0056] Vulnerability assessment Server: This runs the server application which 
consists of a vulnerability assessment tool as well as the vulnerability and script 
database, as well as all the modules that are needed to keep track of the 
various agents that connect to the server as well as various other book-keeping. 
The server communicates with the alert agent and exchanges information with 
the agent. 
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[0057] The vulnerability and script database. The scripts are the vulnerability 
assessment tests. 

[0058] Intranet (part of VPN) 

[0059] Internet (part of VPN) 

[0060] Host/device and agent running Linux desktop. 

[0061] Host/device and agent running on a Microsoft platform desktop. 

[0062] Another host/device and agent running on a Laptop machine. 

[0063] Fig 2 depicts the flow of events in the agent and the destination server in 
one embodiment of the invention. 

[0064] Legend : 

[0065] Agent side 

[0066] Destination server side. 

[0067] Agent side checks if there is any change in the status of port/interfaces 
on the host/device. 

[0068] Agent side communicates changes if any to the server. 

[0069] Server receives data concerning changes from the agent. 

[0070] Server checks if any new ports have been opened or any new interfaces 
have become active. 

[0071] Server runs tests to find which services are running on the newly opened 
ports. 

[0072] Server runs relevant Vulnerability assessment (VA) tests on the 
host/device. 

[0073] Server prepares vulnerability status report. 
[0074] Server prepares vulnerability status report. 
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[0075] Figure 3 depicts the data structures for tracking the start/stop of services 
on the host/device as per one embodiment of the invention. 

[0076] First data structure present on the agent. 

[0077] Message format of message passed from the agent to the server. 

[0078] Second data structure, present on the destination server. 

[0079] Part of the data structure depicting an interface. 

[0080] Part of the data structure depicting an array to store the status of ports. 

[0081] Figure 4 depicts the use case diagram for a design of the system as per 
one embodiment of the invention. 

[0082] 23 Actor : System Administrator 

[0083] 24 Actor: User 

[0084] 25 Actor: Vulnerability Assessment Server Vendor 
[0085] 26 Start of the server and the agent 

[0086] 27 System response to starting of a new listening service (that is, 
opening of a port on which a service listens) 

[0087] 28 System response to stopping of a listening service (that is closing of 
a port on which a service listens) 

[0088] 29 System response to a new network interface becoming active 
[0089] 30 System response to a network interface becoming inactive 
[0090] 31 Stop of the agent 

[0091] 32 System response to update of vulnerability and script database 
[0092] 33 Vulnerability Assessment 
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[0093] Figure 5 depicts the use case named start the server and the agent as 
per one embodiment of the invention 

[0094] Legend: 

[0095] 34 Host/device 

[0096] 35 Alert Agent 

[0097] 36 Vulnerability assessment server 

[0098] 37 Event: starting of the server on the server machine 

[0099] 38 Event: starting of the agent on the host/device 

[00100] 39 Event: Alert agent tracks the ports on which services are listening on 
the host/device 

[00101] 40 Event: Alert agent communicates the above fact to the vulnerability 
assessment server 

[00102] 41 Vulnerability assessment server does Vulnerability assessment and 
reports the results to the agent 

[00103] Figure 6 depicts the use case named system response to start of a 
service as per one embodiment of the invention 

[00104] Legend: 

[00105] 42 Host/device 

[00106] 43 Alert Agent 

[00107] 44 Vulnerability assessment server 

[00108] 45 Event: start of a new service 

[00109] 46 Event: Alert agent tracks the start of the service 
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[00110] 47 Event: Alert agent communicates the above fact (namely the port 
number on which the new service is listening) to the vulnerability assessment 
server 

[00111] 48 Vulnerability assessment server compares the status of open ports 
that it has with the new status and if it finds a difference then it finds which 
service is running and does Vulnerability assessment and reports the result to 
the Agent. (Use case: Vulnerability assessment) 

[00112] Figure 7 depicts the use case named system response on stop of a 
service as per one embodiment of the invention 

[00113] Legend: 

[00114] 49 Host/device 

[00115] 50 Alert Agent 

[00116] 51 Vulnerability assessment server 

[00117] 52 Event: a service is stopped 

[00118] 53 Event: Alert agent tracks the stopping of the service 

[00119] 54 Event: Alert agent communicates the above fact (namely, the port 
number) to the vulnerability assessment server 

[00120] 55 Vulnerability assessment server updates its status of open ports and 
since no new service is started does not do Vulnerability assessment 

[OO121] Figure 8 depicts the use case named system response on a network 
interface becoming active in one embodiment of the invention. 

[00122] Legend: 

[00123] 56 Host/device 

[00124] 57 Alert Agent 

[00125] 58 Vulnerability assessment server 
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[00126] 59 Event: a network interface becomes active 

[00127] 60 Event: Alert agent tracks the above fact that a network interface has 
become active, and notes the numbers of ports on which there are listening 
services on the new interface 

[00128] 61 Event: Alert agent communicates the above fact to the vulnerability 
assessment server 

[00129] 62 Vulnerability assessment server does Vulnerability assessment on 
the services which are listening on the various ports of the new interface(Use 
case: Vulnerability assessment ) 

[00130] Figure 9 depicts the use case named system response on a network 
interface becoming inactive in one embodiment of the invention. 

[00131] Legend: 

[00132] 63 Host/device 

[00133] 64 Alert Agent 

[00134] 65 Vulnerability assessment server 

[00135] 66 Event: a network interface becomes inactive 

[00136] 67 Event: Alert agent tracks the above fact that a network interface 
has become inactive, and notes the numbers of ports on which there were 
listening services on the interface 

[00137] 68 Event: Alert agent communicates the port numbers on which 
services have stopped due to the interface becoming inactive to the vulnerability 
assessment server 

[00138] 69 Event: Vulnerability assessment server updates its local data 
about the particular interface 

[00139] Figure 10 depicts the use case named system response on stopping the 
agent application as per one embodiment of the invention. 
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[00140] Legend: 

[00141] 70 Host/device 

[00142] 71 Alert Agent 

[00143] 72 Vulnerability assessment server 

[00144] 73 Event: a network interface becomes active 

[00145] 74 Event: Alert agent tracks the above fact that a network interface has 
become active, and notes the numbers of ports on which there are listening 
services on the new interface 

[00146] 75 Event: Alert agent communicates the above fact to the vulnerability 
assessment server 

[00147] 76 Event: vulnerability assessment server updates its data. 

[00148] Figure 11 depicts the use case named system response on update of 
vulnerability database as per one embodiment of the inventionLegend: 

[00149] 77 Host/device 

[00150] 78 Alert Agent 

[00151] 79 Security Assurance server 

[00152] 80 Event: vulnerability and script database is updated. 

[00153] 81 Security assurance server does Vulnerability assessment (Use case: 
Vulnerability assessment) 

[00154] Figure 12 depicts the use case named vulnerability assessment as per 
one embodiment of the invention 

[00155] Legend: 

[00156] 82 Host/device 

[00157] 83 Alert Agent 
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[00158] 84 Vulnerability assessment server 

[00159] 85 Vulnerability assessment server does Vulnerability assessment 

[00160] Figure 13 depicts the use case that depicts a current state of the art 
system as per one embodiment of the invention 

[00161] Legend: 

[00162] 87 Host/device 

[001631 88 Server hosting a vulnerability assessment tool 
[00164] 89 Event: starting/booting of the host/device 

[00165] 90 Event: Server does Vulnerability assessment {time: beginning of 
week 0) 

[00166] 91 Event: A service is started 

[00167] 92 Time period in which the service is vulnerable to hacker attacks 

[00168] 93 Event: Server does vulnerability assessment (time: beginning 
of week 1 ) 

[00169] Figures 14 - 17 show the report obtained that is passed to the agent. 

[00170] The subject matter of the invention is further explained in the form of 
following examples. However, this should not be construed as limiting the 
scope of the invention. 

DETAILED DESCRIPTION 

[00171] The subject matter of the present invention is further explained in the 
form of following embodiments. 

[00172] In one embodiment of the invention, a system is described that ensures 
real-time network-based vulnerability assessment of a host/device (figure 1) . 
The system has two components — an agent application (5, 6, 7 and 8) which 
runs on the host/device (5, 6, 7) , and a server application also called the 
destination server or a vulnerability assessment server (1,9), which generally 
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runs elsewhere on the network on a machine which is referred to as destination 
server. (In a special case, both the agent and server can run on the same . 
host/device, but generally the server would be run on one machine, and agents 
would be run on each of the machines on which one wants to do real-time 
vulnerability assessment.) The host/device is any machine that runs a standard 
operating system such as one from the Windows family or from the Unix/Linux 
family, or any networking device such as a switch or a router that runs a real- 
time operating system or it could be an embedded system. The only 
requirement for the host/device is that it be able to run network services to 
communicate with the outside world. Though this invention as described relates 
to the TCP/IP protocol suite, it need not be so. This invention would apply if any 
standard communication protocol for communicating with the outside world is 
used by the host/device. The agent (5, 6, 7) and the server (1) communicate 
between themselves by passing information as described below. The agent is 
used to track in real-time the ports on which network services are listening on 
the various interfaces of the host. This tracking is done by tracking the start and 
stop of various network services on various interfaces and passing the port as 
well as the interface information to the server. The server application is used to 
run vulnerability assessment (VA) tests with the listening services on the 
network interfaces on the host/device as the target of vulnerability assessment. 
To begin with, the server application is started; it does some initial book- 
keeping, and waits to receive communication from the agent. Then, the agent 
application is started on one or more of the target machines. (In the description 
here, the term target machine or the client machine is used interchangeably 
with the terms host or device. All the four refer to the machine or the device on 
which the agent application runs, and whose vulnerabilities this invention 
detects in real-time.) 

[00173] A clarification about the term real-time is in order here. Strictly technically 
speaking, the word "real-time" is used when the time can be measured in clock 
cycles on a real-time operating system. In the present invention the operating 
systems that envisage the host/device to run are not necessarily real-time 
operating systems, and tracking of open ports and subsequent vulnerability 
assessment, though may be possible to pin down to a time interval would be 
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difficult to pin down in clock cycles. Thus, the expression real-time denotes an 
event starting the moment another event happens. In this case, the agent tracks 
the start and stop of services the moment they start and stop, and subsequently 
vulnerability assessment is started the moment it is possible to start it, within 
the constraints of the time taken by the operating systems involved both on the 
host/device and the destination server, and the time delay in communication. 

[00174] One can have a configuration where one server can handle a number of 
agents, one agent each on a host/device. The present invention asynchronously 
starts a number of agents (5, 6, 7) which communicate data to and from the 
server (1) . In fact, it is possible to have a system where tens of thousands of 
agents are served by hundreds of servers. However, for purposes of simplicity, 
in the following description a scenario consisting of one agent and one server is 
considered. 

[00175] The agent is implemented via one or more executable agent modules 
which accomplish its functionality. The agent (8) keeps track of the ports on 
which network services are listening on the various network interfaces of the 
host/device/target machine and stores them in a (first) data structure (18) . In 
one embodiment, this data structure is a simply a two-dimensional array of size 
65535 with one dimension being the status of TCP ports and another status of 
UDP ports (22) . The value of each element of the array is a boolean that 
indicates whether the particular port is open or not. There is a separate array 
for each active interface (21) of the host/device. It then reports those ports as 
well as the IP address of the relevant network interface to the server component 
(9). While reporting, it reports incremental changes in the status of ports that 
are listening (10, 11). In other words, it implicitly reports the start and stop of 
services on open ports. (In the present invention only TCP and UDP services 
are considered in the implementation, but this invention applies to ICMP and 
other non-port based services also. In those cases, instead of transmitting the 
port number on which the service starts/stops, some different attribute will have 
to be passed to the server.) This tracking of open ports may be also done in 
hardware in real-time. The server receives this information (12) and keeps a 
record of it in a (second) data structure (20) . The structure of the second data 
structure is similar to that of the first data structure. The server is also 
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implemented in the form of one or more executable server modules. If the 
server finds that there is a change in the status of the ports on which services 
are listening on any of reported interfaces of the target machine (13) (note that 
when the server starts, the status that it has is that no services are listening on 
any of the ports of any of the interfaces of any of the agent that may connect to 
it), it runs tests to find out which services are running (14) , then runs the 
relevant vulnerability tests on the particular services on the particular interfaces 
of the target machine (15) and reports the results to the target machine (16). 
(To be precise, for the server to run tests, the change in status should be such 
that one or more new service are started on one or more of the ports. If the 
status change is such that some services are stopped, there is no need for the 
server to run fresh tests. It can in fact send the appropriate report of past tests 
done (17) to the agent as since no new services have been started, there would 
be no new vulnerabilities found generally. The only exception here is when a 
new vulnerability is discovered (publicly) and announced, and the server 
vulnerability database is updated with the tests for the new vulnerability. In that 
case, the server would run those vulnerability tests to find out if any of the 
services that it has previously tested do in fact have the new vulnerability. ) 
Thus, the system (comprising of the agent (8) and the server (9) ) ensures that 
vulnerabilities are detected the moment network services having them get 
started on the agent; the moment here refers to the real-time aspect of the 
detection of vulnerabilities. There is of course a certain time involved in 
reporting the ports pertaining to the start, and stop of services of a particular 
interface of the target machine to the server, as well as a certain time involved 
in running the vulnerability tests and reporting the results. This is referred to as 
real-time; that is, even though it cannot be categorized it in clock cycles as is 
done to characterize a real-time application, this is done the moment it is 
possible. Thus the system ensures that at no time - excepting the time taken to 
report the services, and run the tests as described above — the 
host/device/target has network services listening on it which have undetected 
vulnerabilities in them, thus resulting in real-time vulnerability detection for 
services. The system detects vulnerabilities which are present in the software 
executables, as well as vulnerabilities due to erroneous or non-secure 
configuration of network services. (The system as is designed can use various 
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third-party VA tools to detect vulnerabilities provided they can be used to do 
vulnerability testing the way it is stated above; that is, they can be used to do 
vulnerability tests only on particular services that are listening on various ports. 
An example is given using the open-source tool nessus, http://www.nessus.org 
as a vulnerability scanner. The system can also detect backdoors installed; a 
backdoor is a non-standard service, one which a hacker uses plants on the 
users machine. All that is required to detect the backdoors in real-time is for the 
vulnerability assessment server to conclude that services which it can not 
recognize remotely could be potential security holes; backdoors would come 
under the above category. 

[00176] Some variations on the theme of running vulnerability tests are possible. 
In the simplest of variations, the server can run the whole of the vulnerability 
assessment tests every time it notes a change in the status of ports and/or the 
status of interfaces on the host/device. In a second variation, it can find out 
which new port is opened or if any new interface has become active, and do 
tests to detect the services that have started on those ports, and then conduct 
vulnerability tests on those services. It can then produce a whole vulnerability 
status report by concatenating appropriately the previous report that it had, and 
noting the changes in the status of ports that it has now encountered. For the 
above purpose, it stores the results of the vulnerability tests port wise and 
interface wise. Thus, it can concatenate the results for the ports which were 
open previously, with the results for the ports which are open now, and produce 
an overall result. It can also produce an incremental vulnerability report for the 
new services that have now started. 

[00177] A number of variations on the tracking theme are also possible. In one 
variation, the agent can send a message {just a notification) indicating that an 
event has occurred on the host/device that may have changed the vulnerability 
status of the network. This could be a start or stop of a service on an interface. 
The server could then run all the VA tests or do its own investigation to figure 
out which new ports have opened or which ports have closed, and then run the 
appropriate VA tests. In another variation, the agent could in fact pass more 
explicit information — namely the names of services — to the server. The point 
is the agent passes information that indicates that the vulnerability status of the 
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host/device could have changed and vulnerability tests may have to be 
conducted by the server to produce the latest vulnerability status of the 
host/device. 

[00178] Phases of the invention (agent side and server side): 

[00179] The invention consists of a system comprising of a server and an agent 
both of which operate concurrently and which communicate with one another by 
passing information to each other. 

[00180] The invention consists of the following phases on the agent and the 
server side respectively. Please also note that variations on the invention are 
possible, and possible variations are mentioned in other sections of this 
document. 

[00181] Agent Side (8): 

[00182] 1. Tracking the starting and stopping of each of the listening network 
services on each of the open ports of each of the active interfaces on the target 
machine (10), and intimating the open port numbers along with the IP address 
of the interface(s) (11) to the server. 

[00183] 2. Receive the reports from the server and display the results. 

[00184] Please note that phases 1 and 2 on the agent occur concurrently, and 
are not sequential. 

[00185] A report for previously run vulnerability tests may be received at the 
same time information for current status of open ports is sent to the server. 

[00186] Also, phase 1 is done via a daemon service which wakes up once in say 
a certain small enough time interval, and does a polling and reports to the 
server if there is any change in the active status of any of the ports in any of the 
active interfaces. If there is no change, then it sleeps for that particular time 
interval before waking up to check for the above again. The daemon can also 
be implemented in hardware to track the changes in the status in real-time. 
Listening network services would also include possible (listening) backdoors 
that may have been planted by a hacker. Apart from reporting start and stop of 
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services on active interfaces, another case also involves reporting the stop of 
the agent application itself. The server responds to the above case by resetting 
its data about all active interfaces on the agent, as well as the data about the 
agent itself. To the server, the agent is represented as an IP address of the 
interface of the agent through which the agent communicates to the server. A 
third type of case would amount to reporting of an previously active interface 
going inactive. What would be actually reported in the above case is the 
stopping of all services on the interface concerned. 

[00187] As far as hosts/devices running the TCP stack is concerned, listening 
ports corresponding to both TCP and UDP services are reported (19) . The IP 
address of the relevant active interface(s) is also reported (19). Ports on which 
services are reconfigured are implicitly reported, as since the start and stop of 
services are reported, those cases are covered where a service is stopped, 
reconfigured and then restarted. 

[00i88]To implement the above, there is need for a (first) data structure (18) for 
each of the active interfaces(21) . This data structure stores the state of the 
ports - whether open or not (22) — for each of the active interfaces. As the 
status is tracked, this data structure is populated. Comparing the state of the 
ports at two different consecutive intervals on each of the interfaces would help 
find out which are the ports on which new services have started, and which are 
the ports on which services have stopped. This information along with the IP 
address of each of the interface (19) is communicated to the server. New 
interfaces coming up or old interfaces going down are accommodated in the 
data structure. 

[00189] Server Side (9) : 

[00190] 1 . For each of the agents that communicate to the server 

a. ) Receive data (12) about the open ports on which there are listening 

services on the various active interfaces of the agent, 

b. ) compare this data with the earlier data available with the server and 

detect if there is a change in the open status of any port (13) (the server 
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begins initially with the assumption that there are no services listening 
on any of the ports of any of the interfaces), 

c. ) if there is a change in the open status of any port on any of the 

interfaces such that one or more new services are now running, then run 
a network-based VA tool to detect vulnerabilities in the services which 
are running on those ports for that interface, (14, 15) 

d. ) Report the results of the tests to the agent.(16) 

e. ) Repeat steps (a) to (d). 

[00191] Please note that these steps (a) to (e) can take place concurrently to 
process information from each of the interfaces of each of the agents that 
connect to the server. 

[00192] A (second) data structure (20) is needed on the server side for each 
agent that connects to it This data structure stores the state of each of the 
open ports of each of the active interfaces of the agent as reported to it. 
Comparing two different entries filled in at two different time intervals helps to 
conclude whether any new service is started or stopped on any of the ports of 
any of the interfaces of the agent, and take a decision to run vulnerability tests 
on the agent. 

[00193] As is said before, the system can handle a number of agents for each 
server. Potentially, the system could have tens of thousands of agents and 
hundreds of servers serving these agents. 

[00194] The system can do incremental vulnerability assessment. This is one of 
the variations used. In this variation, instead of running a complete VA test on 
learning that the status of port/interfaces on the host/device has changed, the 
server runs tests to find out which are the services running on the open ports 
that now have listening services on them. Having found the services, the server 
runs tests on only those services, and comes up with an incremental VA results. 
A result for a vulnerability test indicates whether the host/device has that 
particular vulnerability or not. The server then stores that results port wise and 
interface wise. That is, say if port numbers 80 and 139 were found open, the 
results of the tests for the service found on port 80, and the service found on 
port 139 are separated out; that is, the results are classified interface and port 
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wise. At any time, the server can come up with the overall vulnerability 
assessment report for the host/device by concatenating the vulnerability 
assessment results for the services running on various ports. This way of doing 
incremental vulnerability assessment saves tremendous bandwidth. If later, a 
new ports is found to be open, and some ports are reported as closed, the 
server runs the vulnerability tests only for the newly opened ports, and produces 
a complete VA report by concatenating reports for the opened ports while 
removing reports for the closed ports from the overall report. 

[00195] Various Scenarios of Deployment of the Invention 

[00196] Figure t shows a typical scenario of the invention. (See the section titled 
Brief Description of the Accompanied diagrams for the legend of the figure.) A 
number of security alert agents{5, 6,7) one each on each of the target 
machines or clients, do tracking of new network services as they start and stop. 
The server, herein called the vulnerability assessment (VA) server (1) , contains 
a database of vulnerabilities (2) as well as a VA tool server. The following 
description will refer to the scenario given in the figure although other scenarios 
are also possible. For instance, one of the scenarios could be the case where 
both the agent and the server are run on the target machine itself. Other 
scenarios could include a server running on the Internet, or a combination of 
two servers — a server on the customer's enterprise system and a master 
server on the Internet accomplishing the job. A fourth scenario could include 
some other combination of agents — say, a number of peer agents, and 
servers comprising of the system, a scenario similar to the one given in the 
figure except that the peer agents communicate among themselves to 
exchange information. 

[00197] Step 1 : The server starts and waits for the agent to communicate to it 

[00198] First, the VA server is started, does some book-keeping and waits for an 
agent (agents) to communicate to it. 

[00199] Step 2: The agent starts, tracks the starting/stopping of services and 
communicates the open port numbers and the IP addresses of the various 
interfaces to the server 
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[00200] This step involves finding out in real-time whenever a new network 
service is started or stopped on a host, 

[00201] The former — namely finding out whenever a new service is started — 
can be achieved either by deploying appropriate hooks to track the above in 
real-time or by running a service such as rietstat every few seconds to detect 
the above. 

[00202] The concept of tracking the start or stop of a service itself may not be 
new. Hooks have been deployed in various network services for various 
reasons in different applications. For instance the famous TCP wrapper 
program [4] [Practical Unix and Internet Security, Simson Garfinkel and Gene 
Spafford, 2 nd Edition, 1996, Oreilly] which protects network services by 
restricting access to network services based on the source IP address of the 
client accessing the service replaces the calls accessed by a service to access 
the ports by its own calls which in turn calls the service's calls after doing the 
appropriate kind of filtering. 

[00203] Step 3: Intimation to the VA tool 

[00204] The fact that a new network service is started or stopped is intimated to 
the VA server in this step. In both the cases, if there is a port number 
associated with the service, then port number on which the service is listening is 
intimated. This step is carried out by the agent on the target machine by 
communicating to the server using a utility such as sockets. 

[00205] Step 4: The server checks if any new ports on which services are 
listening have been opened, and if so does vulnerability assessment tests on 
those services 

[00206] Knowing the fact that a new service has been started or that the 
configuration of a particular service has been changed, the VA tool which is 
present on the server runs various vulnerability assessment tests on the 
particular service on the target machine. On the basis of the tests, the VA tool 
concludes if there has been any vulnerability found in the particular service. 
While doing so, the VA tool only runs the minimum tests necessary so as to 
save bandwidth; to this end, it makes maximum use of the information that it 
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has received in phase 3 above. For instance, it would know which ports were 
open before and which services were running on them, so it would not need to 
run VA tests on those services again. After running the tests, it sends the report 
to the agent. 

[00207] Accomplishments of the invention 

[00208] What the invention described above accomplishes is a system wherein 
there do not exist undetected vulnerabilities in any of the network services that 
run at "any" time. Of course, this is subject to the capabilities of the 
vulnerabilities assessment tool used. Any is quoted because strictly speaking 
there is some time involved between manifestation of a vulnerability and 
detection of it, what is referred to as "detection in real-time". The real time 
tracking of the status of ports which amounts to tracking of the beginning and 
ending of services on all the active interfaces is the key to this aspect. The 
above is the major technical advantage of the invention which is not found 
elsewhere. Expressed in different words, this invention is a generalization of an 
online anti-virus package such as Norton's when applied to vulnerabilities. Just 
as an anti-virus package continually looks for viruses and blocks them, as well 
as updates new virus information from the company's web-site, the invention 
described does so for vulnerabilities, except that it does not fix security holes, it 
only detects the vulnerabilities. It "continually" looks for vulnerabilities in 
services and reports them. It also detects backdoors in real-time. Also, it can be 
augmented to have the ability to update itself with new vulnerability information 
so as to keep itself current. The augmentation that does the above has been 
included in the description in the claims and UML modeling sections that follow. 

[00209] The above invention also gives rise to deploy and forget model for a real- 
time vulnerability assessment tool. All current tools do vulnerability assessment 
off-line that is once in a while. They have to be specifically instructed as to when 
to run VA tests. A product based on this invention makes it possible for 
companies to just install this product once, and get vulnerability alerts the 
moment the vulnerabilities occur whenever they want. They need not explicitly 
run a VA tool; a VA tool implicitly gets run whenever is needed and to the extent 
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needed. They also need not miss any vulnerability. Thus, this invention gives 
rise to intelligent vulnerability assessment. 

[00210] A third major accomplishment of this invention is the incremental nature 
of running the VA tool. In order to find the vulnerabilities, the server notes the 
difference between which new ports, and hence which new services are now 
open in comparison with the last run of the VA tests, and only runs those 
vulnerability tests that are needed. Thus, this invention accomplishes 
vulnerability assessment without the bandwidth hog that would be needed if one 
were to run a complete vulnerability scan on the target. 

[00211] The above three accomplishments make a product based on this 
invention ideally suited for sitting continuously on enterprise/consumer systems. 
By consuming little bandwidth and at the same time continuously keeping a vigil 
on the start and stop of services, one can just install this agent and server and 
rest assured that one will get an alert whenever a new vulnerability occurs on 
one's system. One is not even required to schedule any vulnerability tests as 
happens with current tools. 

[00212] All the above accomplishments of course come at a price. The 
requirement to install an agent is the price that is paid. 

[00213] UML Modeling 

[0021 4] The system that is envisaged is described here, using UML notation. [15] 
[Visual Modeling with Rational Rose and UML, Terry Quatrani, Addison Wesley, 
1998] . Note that the description given is a sample description and variations on 
the theme are possible. 

[00215] Actors 

[00216] In UML terminology, actors are those entities that interact with the 
system. They are not part of the system, but they are those entities who use the 
system and for whom in a sense the system is built. 

[00217] The actors in the present system are given below. 

[00218] 1 . Sys Admin/Security Manager 
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[00219] The sys. Admin/Security Manager is responsible for installing the tool 
(both the agent and the server) as well as starts the agent and server 
applications of the tool. 

[00220] 2. Vulnerability Assessment Server Vendor 

[00221] The vulnerability assessment server vendor is responsible for 
carrying periodic updates to the server by adding new vulnerabilities to the 
vulnerability database as they get discovered, as well as by adding scripts to 
test for the new vulnerabilities discovered. 

[00222] 3. User 

[00223] The user uses the host/device and during the course of the use of the 
system starts and stops various network services on various ports. 

[00224] Note: Network services get started and stopped by other programs 
also. For instance, a program can start a mail service and use it. A hacker might 
plant a backdoor which could be a listening service. 

[00225] Use Cases 

[00226] Use cases signify important functionality of the system. Each use 
case signifies a particular major functionality that the system delivers to the 
actors. There are eight use cases in the present system. They are the following: 

[00227] 1) Start of the server and the agent 

[00228] 2) System response to starting of a new listening service (that is, 
opening of a port on which a service listens) 

[00229] 3) System response to stopping of a listening service (that is closing 
of a port on which a service listens) 

[00230] 4) System response to a new network interface becoming active 
[00231] 5) System response to a network interface becoming inactive 
[00232] 6) Stop of the agent 
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[00233] 7) System response to update of vulnerability and script database 
[00234] 8) Vulnerability Assessment 
[00235] Actors and Use cases 

[00236] The interaction of the actors with the use cases is given in Figure 4 . 
(See the section titled Brief Description of the Accompanied diagrams for the 
legend of the figure.) 

[00237] 1) Sys. Admin communicates (23) with use case 1 (26) 

[00238] 2) User (24) communicates with use case 2 (27) (Use case 2 can 
also happen on spontaneous start of a listening service, that is without the 
interaction with the user.) 

[00239] 3) User communicates with use case 3 (28) (can also happen on 
stop of a listening service initiated by other means) 

[00240] 4) User communicates with use case 4 (29) (can also happen on 
coming up of an interface initiated by other means) 

[00241] 5) User communicates with use case 5 (30) (can also happen on 
going down of an interface initiated by other means) 

[00242] 6) Sys admin communicates with use case 6 (31 ) 

[00243] 7) Security vendor communicates(32) with use case 7 

[00244] 8) Use case 8 (33) is used by use cases 1 to 7 

[00245] Objects and classes 

[00246] A first cut design of the system involves three major classes. The 
host/device (this basically involves the hardware and the operating system) is 
modeled as one class, the agent application that is deployed on the host/device, 
one that tracks the start and stop of the services on the host/device is modeled 
as a class and the server which runs the VA tool is modeled as a class. 

[00247] Details of the use cases and sequence diagrams 
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[00248] 1 . Start of the server and the agent 

[00249] Brief Description: This use case is started by the sys. Admin; it 
ensures that the server and the agent is started; the agent on being started 
reports the ports on which listening sen/ices are started to the server, which 
runs a VA tool to detect vulnerabilities in the above services. 

[00250] Event flow 

[00251] Preconditions: None 

[00252] Main Flow: 

[00253] This use case is started by the sys-admin. Basically, he starts the 
server on the server machine and the agent on the target host/device 
respectively; the agent application deployed on the target host/device 
communicates to the server running the VA tool the port numbers on which 
listening services have been started. The server runs the VA tool, which detects 
vulnerabilities in the target. At the end of the use case, the system does not 
have any undetected vulnerabilities. Of course, this is. subject to the fact that the 
vulnerability assessment tool is up-to-date with scripts for all the vulnerabilities. 
The steps beginning from the agent intimating to the server about the starting of 
the host/device to detection of vulnerabilities is carried out by Use case 8. 

[00254] Sub flows: None 

[00255] Alternate flows: None. 

[00256] The sequence diagram for this use case is shown in Figure 5 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00257] 2. System Response on the start of a listening service 

[00258] Brief Description: This use case is started by the user or any program 
which starts a network service; it ensures that the network service that is started 
is tracked in real-time, and checked for vulnerabilities, so that the system does 
not have any undetected vulnerabilities. 
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[00259] 



Preconditions: Use case 1 should have occurred. 



[00260] 



Main flow: 



[00261] This use case is either started by the user of the system or by some 
other program which starts a network service. Basically, this use case leads to 
starting of a network service on the host/device and subsequent checking of 
vulnerabilities in the particular service. The agent tracks the starting of the 
service and communicates the number of the open port to the server, which 
using Use Case 8 detects the vulnerabilities in the system. Thus, at the end of 
this use case, the system does not have any undetected vulnerabilities. The 
second condition occurs because the system already has no undetected 
vulnerabilities via use case 1, which is a precondition for this use case, before 
the network service is started. 

[00262] Sub flows: None 

[00263] Alternate Flows: None. 

[00264] The sequence diagram for this use case is given in Figure 6 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00265] 3. System response on the stop of a service 

[00266] Brief Description: This case is the same as Use case 2 except for the 
fact that the service is stopped. 

[00267] Preconditions: Use Case 1 has occurred before, and a service is 
running. 

[00268] Main flow: 

[00269] This use case is either started by the user of the system or by some 
other program which stops a network service which was started. Basically, this 
use case leads to stopping of a network service on the host/device and 
subsequent tracking of the stop and communicating it to the server, and the 
server passes an updated report of vulnerabilities back to the agent. 
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[00270] The agent tracks the stopping of the service and communicates the 
port number on which the service was previously listening to the server. The 
server would note that this service was once running and is now stopped, so 
there are no new vulnerabilities to be detected, and it would update the report 
and pass it to the agent. . Thus, at the end of this use case, the user gets a 
system does not have any undetected vulnerabilities as before. 

[00271] Sub flows: None 

[00272] Alternate flows: None. 

[00273] The sequence diagram for this use case is given in Figure 7 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00274] 4. System response to a new network interface becoming active 

[00275] Brief Description: This use case is started by the User or via other 
means; it starts when a new interface comes up; the agent notes which are the 
open ports on which there are listening services on the new interface, and 
reports those ports to the server. The server runs a VA tool to detect 
vulnerabilities in the above services. 

[00276] Event flow 

[00277] Preconditions: None 

[00278] Main Flow: This use case is started by the User or via other means; it 
starts when a new interface comes up; the agent notes which are the open 
ports on which there are listening services on the new interface, and reports 
those ports to the server. The server runs a VA tool to detect vulnerabilities in 
the above services. 

[00279] Sub flows: None 

[00280] Alternate flows: None. 
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[00281] The sequence diagram for this use case is given in Figure 8 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00282] 5. System response to a network interface becoming inactive 

[00283] Brief Description: This use case is started by the User or via other 
means; it starts when an interface which was once up goes down; the agent 
notes which were the open ports on which there were listening services on the 
interface, and reports those ports to the server along with the fact that those 
ports are now closed. The server updates the data that it has regarding the 
above interface. 

[00284] Event flow 

[00285] Preconditions: None 

[00286] Main Flow: This use case is started by the User or via other means; it 
starts when an interface which was once up goes down; the agent notes which 
were the open ports on which there were listening services on the interface, and 
reports those ports to the server along with the fact that those ports are now 
closed. The server updates the data that it has regarding the above interface. 

[00287] Sub flows: None 

[00288] Alternate flows: None. 

[00289] The sequence diagram for this use case is given in Figure 9 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00290] 6. Stop of the agent 

[00291] Brief Description: This use case ensures that the server updates it 
data after a graceful close by the agent. 

[00292] Preconditions: Use case 1 has occurred. 

[00293] Main Flow: 
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[00294] This use case is started by the sys. Admin. When he stops the agent 
application, the agent communicates to the server that the agent application has 
stopped. Thus, the server updates its data to note it. This use case is especially 
applicable for agents having DHCP addresses as there is then no mix-up on the 
server side if a machine on a different agent later connects to the server with 
the same IP address as of the earlier agent which had connected earlier. 

[00295] Sub flows: None 

[00296] Alternate flows: None 

[00297] The sequence diagram for this use case is given in Figure 10 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00298] 7. System response to update of vulnerability and script database 

[00299] Brief Description: This use case ensures that the system does not 
have any undetected vulnerabilities that are newly discovered and announced 
through a forum such as CVE. As new vulnerabilities get discovered, they are 
added in the vulnerability database and the system tested for presence of these 
vulnerabilities. 

[00300] Preconditions: Use case 1 has occurred. 
[00301] Main Flow: 

[00302] This use case is started by the vulnerability server vendor. As new 
vulnerabilities get discovered, the vendor updates his vulnerability and script 
database. On a signal that the vulnerability database is updated, the VA server 
scans the target system for presence of these new vulnerabilities, and if found 
sends a report to the agent. This is carried out using Use Case 8. 

[00303] Sub flows: None 

[00304] Alternate flows: None 
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[00305] The sequence diagram for this use case is shown in Figure 1 1 . (See 
the section titled Brief Description of the Accompanied diagrams for the legend 
of the figure.) 

[00306] 8. Vulnerability assessment 

[00307] Brief Description: This use case is used by other use cases to detect 
vulnerabilities (See description of other use cases above.) This use case 
ensures that the target system is checked for vulnerabilities, so that the system 
does not have undetected vulnerabilities. 

[00308] Precondition: One of the following must occur. 

[00309] a. The agent is started and the list of open ports on which services 
are listening are communicated to the server. 

[00310] b. A network service is started and the agent communicates the port 
number on which the service is started to the server. 

[00311] c. The vulnerability and script database is updated with one or more 
new vulnerabilities and scripts. 

[00312] Main Flow 

[00313] a. This use Case initiated by Use Cases 1 to 6. Subflow S1 is taken. 
[00314] b. This use Case is intiated by Use Case 7. Subflow S2 is taken. 
[00315] Subflow S1: 

[00316] The VA tool on the server checks if there is any change in status of 
open ports on the target system; if there are any "new" open ports, then it finds 
remotely what services are running on those ports, tests those services for 
vulnerabilities, and sends the report to the agent. 

[00317] Subflow S2: 

[00318] When this use case is initiated by Use Case 7, this flow is taken. 
When new VA tests tare added to the vulnerability database, this flow checks if 
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there are any services running which pertain to these new tests, and if so these 
tests are run, and the results reported to the agent. 

[00319] Alternate Flows: None. 

[00320] A high-level sequence diagram for this use case is shown in Figure 
12 . (See the section titled Brief Description of the Accompanied diagrams for 
the legend of the figure.) 

[00321] Sequence Diagram for a current state-of-the-art system 

[00322] Figure 13 gives the sequence diagram of a system which is of the 
current state of the art. (See the section titled Brief Description of the 
Accompanied diagrams for the legend of the figure.) It is to be noted that since 
vulnerability assessments are done once in a week or some such regular 
interval as per the security policy of the enterprise, services that are started in 
the middle of this period remain vulnerable at least up to the time the next 
vulnerability assessment is conducted, and this time could be substantial thus 
making the system prone to exploitation by hackers. Of course, if these services 
are stopped during the time the VA tool is run, and restarted again after the VA 
tool has finished running, vulnerabilities in them may never get detected. 

[00323] Examples 

[00324] There are tens of examples that can be given for illustrating the 
scenarios that are covered by the present invention. Here, the present invention 
is illustrated with two simple examples. 

[00325] Denial of service attack on an X server 

[00326] Consider a Red Hat 7.0 Linux system as the host/device which starts 
in run level 3, with the X server not being started. As the system starts, an 
agent perched on the system intimates to the VA server the start of various 
services, and the VA server checks it for vulnerabilities; then the system does 
not have any undetected vulnerabilities. Now the user starts the X server 
possibly by taking the system to run level 5, a level in which Red Hat 
automatically starts the X server. The alert agent tracks the above in real-time 
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and intimates to the server running the VA tool that a new service has been 
started on the particular port 6000; the server does the relevant VA tests and 
comes up with the following VA assessment. 

[00327] X server is running on port 6000. Although the X server does not 
allow any client to connect to it, an attacker may send garbage data and slow 
down the X session or even kill the server [14] [www.nessus.org, Nessus, the 
open-source VA tool]. The CVE [3] [http://cve.mitre.org] number is CVE-1999- 
0526. The recommendation is to filter the incoming connections to port 6000- 
6009. 

[00328] The alert agent is intimated of the results of VA. 
[00329] Response to start of a service on port 80 

[00330] The present invention has an agent running on a Windows 2000 
system. The agent application starts and the VA server is intimated of the open 
ports where various services have been started, which runs a VA tool (in this 
case nessus) and the report is shown below. An IIS web server is started on the 
Windows 2000 system. The agent reports the fact that new ports have been 
opened (namely ports 80 and 443) and the server runs tests first to find out 
which services are running on those ports, and then runs various vulnerability 
tests on the services. The report obtained is passed to the agent as shown in 
Figures 14 - 17 . 

[00331] Implementation Issues: 

[00332] A very brief implementation overview of implementing this invention 
with Nessus, the open source VA scanner is given below. However, this 
invention by itself is not constrained by the use of Nessus. Any Vulnerability 
assessment tool which is designed in a modular fashion should be usable. 
However, it is not necessary that the implementation has to be implemented 
with a current VA tool. A new VA tool suited for the purposes of the 
implementation can also be written. 

[00333] Overview of Nessus: 
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[00334] An overview of Nessus is provided to understand the present system 
implementation. Nessus is an open-source VA scanner available at 
http://www.nessus.org. Nessus consists of two parts: a nessusd server which 
runs as a daemon (on a Unix machine), and a nessus client. The nessusd 
server is the VA engine, while nessus client helps a user to appropriately 
configure nessusd for one's use. Nessus can be used via a GUI or via a 
command line option. There is a concept of plugins in the way nessus and 
nessusd are designed. A plugin consists of a vulnerability test. The way nessus 
is designed one can write plugins separately and add to nessus and nessusd on 
the fly in the sense plugins don't have to be compiled with nessus or nessusd 
at compile time. A lot of the plugins (the .nasi plugins specifically) are 
interpreted. There is a plugin directory in which plugin files are placed, and 
nessusd reads the plugins from this directory every time it is started. 

[00335] Thus, one can populate the plugin directory with the plugins one 
wants, and start nessusd. 

[00336] There are also configuration files that both nessusd and nessus use. 
The nessusd configuration file is called nessusd.conf while the nessus 
configuration file is called .nessusrc. These files can be configured to one's 
liking to tune how nessusd and nessus are run. 

[00337] There is also a knowledge base (KB) that the plugins of nessus 
populate and use. A more detailed explanation including the source code of 
nessus is available at http://www.nessus.org. 

[00338] There are a number of issues to be resolved when deciding how to 
invoke nessus for the purposes of real-time VA. The issues involved and the 
solutions are discussed here. 

[00339] Using nessus for real-time vulnerability assessment 

[00340] The requirements for using nessus for real-time VA are the following. 
Initially, VA test is performed on the services running on specific ports on the 
host/device. These port numbers will be intimated to us. In other words, if a 
specific port say port number 25 is open on the host/device, it is necessary to 
identify the service running on it, and then run vulnerability assessment tests for 
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that service. Specifically, the present invention should be able to do this on say 
the only port which is given to us. Other ports may be open on the host/device 
at that time, 

[00341] Issues concerning Nessus 

[00342] The way nessus and nessusd run bring specific problems when the 
above requirements are considered. 

[00343] Running Nessus as a whole 

[00344] Nessus consists of nessusd, the server which runs as a daemon and 
nessus the client. 

[00345] When nessusd and nessus are run as a whole, the following takes 
place. All the plugins are loaded from a directory meant for plugins (this 
directory is specified in the ne33u3d.conf file) while starting ne3eu3d, and then 
nessus is used to run the tests on a particular IP address as target. The plugins 
that are loaded usually consist of a port scanner such as nmap, plugins such as 
find_services which identify the services running on specific ports, and plugins 
meant for specific services and for standard ports (this is explained in detail 
below). 

[00346] The way nessusd and nessus work is that plugins populate a KB 
(knowledge base) for the above purposes. Some plugins populate the various 
attributes of the KB. Other plugins read these attributes and use the values 
placed in them to make various decisions. The key here is that a plugin that 
uses the values placed in the various attributes of the KB assumes that the 
plugin which populates the attributes has run before it and done its job. If the 
previous plugin hasn't run, the concerned plugin will quietly not to do anything. 

[00347] In other words, the plugins on which the concerned plugin is 
dependent have to be run to get sensible results. 

[00348] Plugin issues: script__require_ports 

[00349] A plugin can be of various types: namely a .nes, a .inc or a .nasi 
plugin. 
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[00350] A .nasi plugin may have a line in its code that has the attribute 
script__require_ports in it. 

[00351] For instance, a plugin can have the following line 
[00352] Script_require_ports(^ww/services ,, ( 80) 

[00353] What the above means is that the plugin will be launched if the 
attribute www/services is filled up in the KB. In the absence of that attribute 
filled up, it will run on port 80 if the port 80 is open. 

[00354] In effect, what the above means is that the plugin is meant to be run 
for the WWW service. If there is no such service running and if port 80 is open, 
it assumes that the WWW service exists on port 80 and runs itself. 

[00355] The www/services part of the attribute will be filled by the 
find__services plugin which should be run before this plugin. 

[00356] The find_services plugin will also be stated in the dependency list of 
the above plugin which is described below. 

[00357] Dependency list of plugins 

[00358] A .nasi plugin has a dependency list. The dependency list gives the 
list of plugins vyhich the plugin depends on, and which should be run before the 
plugin is run. 

[00359] The auto_run_dependencies, if set in the nessusd.conf file will 
automatically run the dependencies of the plugin. 

[00360] Find_services plugin related issue 

[00361] Find_services.nes plugin finds the service which run on a specific 
port. It picks up the port numbers from the KB (a port scanner or some other 
plugin must populate the KB before the find_services plugin is run) and then it 
populates attributes of the KB pertaining to services which it has found on the 
ports. For instance if it finds the WWW service on port 62, it would populate 
WWW/services, to be 62. 
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[00362] The problem with fincLservices is that it does the above only for TCP 
services, and not for UDP services. 

[00363] In the absence of find__services.for UDP, UDP plugins will be run on 
all ports. 

[00364] Thus, to implement this invention using nessus a find_services 
plugin for UDP has to be written. 

[00365] Port Scanner Related Issue 

[00366] The requirement is such that, since a list of ports is given, there is no 
need to run the port scanner. However, run of a port scanner or equivalent is 
needed in nessus since the attributes corresponding to open ports have to be 
populated in the KB. Thus, an equivalent plugin has to written to replace the 
port scanner. This new plugin would take a list of one or more ports and 
populate the KB attributes appropriately. 

[00367] Other Issues: Restarting nessusd as against operating through 
.nessusrc changes 

[00368] Nessus author recommends that nessusd to be started and load all 
the plugins. Then, nessus is run and by giving an appropriate .nessusrc while 
running nessus, it can be decided which plugins are required to be run for a 
particular run. 

[00369] It has been found that this process is 4 to 5 times slower than if only 
those plugins are loaded that are needed while starting nessusd in the first 
place, and giving an empty .nessurc while running nessus. 

[00370] Thus, there are two ways of running nessusd and nessus now. By 
loading the plugins appropriately and restarting nessusd or by overriding the 
plugin list via .nessusrc. the solutions involving both are examined below. 

[00371] Other Issues: Services running on Non-standard ports 

[00372] In general, it is possible, though rare, that a service runs on non- 
standard ports: That is, one can have an smtp server running on port 80 for 
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instance. In the following discussion two cases are considered: case a) services 
running on their own standard ports b) a service could be running on any port, 
not necessarily its own standard port. 

[00373] Running Nessus for real-time VA 

[00374] Considering the above preamble, the present system is ready to run 
nessus for real-time VA. 

[00375] The nmap is substituted, the port scanner used by nessus with the 
present invention port scanner equivalent plugin, one that takes a list of ports 
and populates the KB just the way nmap would have, had it found the same 
ports open. 

[00376] A find_services plugin for UDP is added. 

[00377] considering the case when the only port given to us is say port 25. 

[00378] Case 1) Services Run only on their own standard ports 

[00379] a) The standard way, that is by loading all plugins first and then 
overriding plugins via .nessusrc 

[00380] Running nessus the standard way. That is, start nessusd by loading 
all the plugins, run the port scanner equivalent plugin, run find services plugins 
— Tcp or Udp depending on what is running on port 25, and from the service 
found run the appropriate plugin(s) for the service found. 

[00381] This should work fine except for the fact that this way could be slow. 

[00382] b) the Faster way, only load the plugins that are needed 

[00383] Here only the plugins that are needed are loaded; that is, the port 
scanner equivalent, the find_services plugin and the plugins which have 25 in 
the script_require_ports. An empty .nessusrc is given, restart nessusd and run. 
That would be fast. 

[00384] Case 2) General Case: Services can run on any port not necessarily 
standard ports 
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[00385] The standard way, by loading all plugins and overriding via .nessusrc 

[00386] This should be the same as Case 1) standard way. A bit slower but 
no complex implementation issues. 

[00387] The Faster way, by only loading the needed plugins 

[00388] The big implementation issue here is the following: plugins cannot be 
changed dynamically in nessusd except through a restart. And which service is 
running can be known only after running find_services, hence it has to be done 
in two steps, and store and recover the KB in between the two runs. 

[00389] Run 1) 

[00390] Load port_scanner_equivalent and find_services, UPD or TCP as is 
the case. Launch the plugins and populate the KB with the appropriate attribute 
depending on the service found. 

[00391] Save the KB. 

[00392] Run 2) 

[00393] Read the KB, and depending on the service, find out which plugins 
have to be loaded. For instance if the attribute filled up is WWW/.services then 
all .nasi plugins which have WWW/services in the script_require_ports will have 
to be loaded. 

[00394] Then, have all the plugins in the plugin directory and restart nessusd 
with the appropriate plugin directory at the same time recovering the KB. 

[00395] Then run those plugins. 
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